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ABSTRACT 

The investigation assessed the effects of three 
increasingly inclusive versions of the Behavioral Consultation (BC) 
model on problem behavior in mainstream classrooms, in an effort to 
develop an effective and efficient approach to pre-referral 
intervention. Subjects were 43 general educators, their 43 most 
dif ficult-to-teach nonhandicapped students, euid 12 school 
consultants, representing seven inner-city middle schools. Among 31 
experimental teachers, 10, 10, and 11 teachers were randomly assigned 
to a least, more, and most inclusive variant of BC, respectively. 
Pre-intervention, post-intervention, und follow-up observations of 
student behavior indicated that more inclusive BC versions exerted 
stronger effects than the least inclusive varieoit in reducing problem 
behavior. While more inclusive versions of BC require more time and 
energy from school personnel, consultemts found that these versions 
required only an average of 6 hours of their time per student. 
Conducting a least-inclusive version of BC was found to be better 
than talcing no action at all. ( Author /JDD) 
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Abstract 



The purpose of this investigation was to assess effects of three increasingly 
inclusive versions of the Behavioral Consultation (BC) model on problem 
behavior in mainstream classrooms in an effort to develop an effective and 
efficient approach to prereferral intervention. Subjects were 43 general 
educators, their 43 most difficult- to- teach nonhandicapped students, and 12 
school consultants, representing seven inner-city middle schools. Among 31 
experimental teachers, 10, 10, and 11 were randomly assigned to a least, more, 
and most inclusive variant of BC, respectively. There were 12 control 
teachers. Pre-intervention, post-intervention, and follow-up observations of 
student behavior indicated that more inclusive BC versions exerted stronger 
effects than the least inclusive variant in reducing problem behavior. 
Theoretical and practical implications for consultation-related activity are 
discussed. 
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Prereferral - 1 

Prereferral Intervention: A Prescriptive Approach 

Since the U.S. Department of Education's first child count In 1976-1977, 
the number of students served under the Education for All Handicapped 
Children's Act and Chapter 1 has grown each year, with an Increase of 712,688 
children, or 16X, from 1976-1977 to 1986-1987 (see U.S. Department of 
Education, 1988, Table 1, p. 4). It Is likely that this Increase reflects 
attempts to provide handicapped children with an appropriate education. 
However, there Is Increasing suspicion that too many children are being 
Identified. Incorrect Identification Is undesirable for numerous and obvious 
reasons. Including that It causes unnecessary separation and stigmatlzatlon of 
children (e.g., Reyiolds & Balow, 1972), disrupts school programs (e.g.. Will, 
1986), and Is costly (e.g.. Singer, 1988). 
Teacher Referrals 

Contributing to the apparent overldentlflcatlon of handicapped children 
Is a large number of teacher referrals. New referrals to special education 
for the 1984-1985 school year, reported by 28 large urban districts (Research 
for Better Schools, 1986), ranged from a low of 600 (Memphis, TN) to a high of 
33,855 (New York City). The median number of new referrals for the districts 
was 2,358. On average, 54.52 of these students were certified handicapped, 
thereby Indicating the Importance of teacher referral to eventual special 
education placement. Burgeonning numbers of teacher referrals and special 
education placements represent an Important rationale for "prereferral 
Intervention 

Prereferr intervention 

Definition. Prereferral Intervention refers to a teacher's modification 
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of Instruction or classroom management prior to referral to better accommodate 
a difficult- to- teach (DTT) nonhandlcapped pupil. This activity Is often 
''brokered*' by one or more support staff such as a special educator or school 
psychologist who works Indirectly with a targeted DTT student through 
consultation with the teacher. Implicit In this definition Is a preventive 
Intent; that 1s» (a) eliminating Inappropriate referrals while Increasing the 
legitimacy of those that are Initiated and (b) reducing future student 
problems by strengthening the teacher's capacity to Intervene effectively with 
a greater diversity of children. This preventive thrust jibes with the least 
restrictive doctrine described In PL 94-142, requiring educators to attempt to 
accommodate DTT students' Instructional and social needs In the most "normal" 
setting possible. 

Popularity and evidence of success . Prereferral Intervention's 
popularity Is suggested by a recent survey of 49 state directors of special 
education (Carter i Sugal, 1989). Thirty-four claimed they either required {n 
» 23) or recommended {n - 11) their respective local education agencies to 
establish such Interventions. Nevertheless, databaseo Investigations of their 
effectiveness have been few and far between. Corroborating this view Is a 
recent computer search of the ERIC database (from January, 1983 to September, 
1988). Based on numerous combinations of clusters of ERIC "key words," the 
search produced only three empirical Investigations of prereferral 
Intervention's effectiveness. We know of only eight additional pertinent and 
published studies. At best, this Infrequent research Is only suggestive of 
prereferral Intervention's Importance. Given this, respondents 1r the Carter 
and Sugal (1989) survey expressed appropriate, yet surprising, tentatlveness 
when asked to judge Its efficacy. Three*quarters of the state directors 
claimed that prereferral Intervention was successful only "sometimes" or 
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admitted ''no basis for determining" Its success* hardly overwhelming 
confidence In so popular a strategy. 

To help find ways to strengthen general educators' capacity to 
accommodate non handicapped (and handicapped) DTT pupils' Instructional and 
social needs, Special Educaliori Programs In the U.S. Department of Education 
sponsored an Enhancing Instructional Program Options research Initiative In 
1985. "Mainstream Assistance Teams/ a 3-year project to develop, Implement, 
and validate prereferral Intervention In an urban school system, was funded as 
part of this federal Initiative. 

Mainstream Assistance Teams (MAT) 

He embedded prereferral Intervention within a larger process of teacher 
consultation as have others before us (e.g., (^ntrell t Cantrell, 1976; 
Chalfant, Pysh, ft Moultrie, 1979; Graden, (^sey, t Bonstrom, 1985). The model 
of teacher consultation employed Is known as Behavioral Consultation. It was 
selected because a steadily growing corpus of school-based research Indicates 
Its effectiveness In Increasing pupils' academic performance and decreasing 
their general disruptlveness (e.g., Sibley, 1986; Tombarl t Davis, 1979). 
Although much has been written about Behavioral (k)nsultat1on (e.g., Bergan, 
1977), proper understanding of the MAT project requires a brief reiteration of 
this consultation approach. 
Behavioral Consultation (BC) 

Definition . BC Involves a triadic network cf consultant, teacher, and 
pupil along with Indirect service; that Is, consul tantr attempt to change 
students' school performance or behavior by working with teachers. Unlike 
alternative consultant models, BC encourages exploration of antecedents and 
consequences of behavior In naturalistic settings to permit Identification of ^ 
variables Influencing frequency. Intensity, and/or duration of problem 
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behavior. Behavioral consultants view the teacher, and often the student, as 
a problem solver who participates as a co-equal In designing Intervention 
strategies, which typically are based on empirically va Idated laws of 
behavioral change. Evaluation of planned Interventions Is databased; 
effectiveness Is judged In terms of whether student or teacher behavior has 
met previously set goals. 

Stages of BC. BC Is conducted within a series of four interrelated 
stages: problem Identification, problem analysis, plan implementation, and 
problem evaluation. Consultants guide teachers through a majority of these 
stages In a succession of structured Interviews In which specific objectives 
must be accomplished before consultation may proceed to subsequent stages. 

Major objectives of the first stage, problem Identification , are to 
define the problem behavior In observable terms and obtain a reliable estimate 
of Its frequency. Intensity, or duration. In the problem analysis stage, the 
goal Is to validate the existence of a problem. Identify Instructional and 
student variables that may contribute to a solution, and collaboratively 
develop an appropriate plan. During plan Implementation , the consultant 
monitors Implementation and provides corrective feedback, helping ensure the 
Intervention is delivered as designed. The goal of the final stage, problem 
evaluation . Is for consultant and teacher to evalijate the effectiveness of the 
Intervention, and. If It has proved Ineffective, to determine modifications. 

Component analysis of BC. A basic and widespread assumption in the BC 
literature Is that all four stages of the model are critical; none is 
Indespensable (cf. Gresham, 1982). Nevertheless, a review of the pertinent 
literature Indicates no previous component analysis of BC. That Is, 
systematic attempts to determine the relative value of the various stages of 
BC are lacking. 
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The apparent absence of such effort seems to reflect a more general 
dearth of process-outcome research in the consultation literature (e.g., 
Alpert t Yammer, 1983; Medway, 1982; Meyers, Pitt, Gaughan, t Freidman, 1978; 
West t Idol, 1987; Witt ft Elliott, 1983). This is unfortunate since 
process-outcome research, like component analysis, might help identify one or 
more stages of consultation that may be implemented in abbreviated fashion, or 
perhaps eliminated altogether, without loss of benefit to teachers and 
students. In other words, component analysis may contribute to development of 
a simultaneously effective and efficient consultation process, one that 
effects meaningful change but requires a minimum of time, effort, and 
resources. The importance of economy to consultation is signalled by the 
frequently mentioned fict that insufficient time prevents many building 
support staff from engaging in consultation (e.g., Alpert, 1980). Paralleling 
the logic of those who have demonstrated a strong relation between degree of 
efficiency and teacher acceptability of interventions (e.g., Elliott, Witt, 
Galvin, ft Peterson, 1984; Reimers, Wacker, ft Koeppl, 1987; Witt, M^'^tens, & 
Elliott, 1984), we believe that development of a consultation process that is 
economical as well as effective can only increase the frequency with which 
special educators, school psychologists, and other support personnel undertake 
consultation. 

MAT Research U Year JL ( 1985-1986 ) 

Year 1 activity was conducted in seven middle schools in a large urban 
school district in the Southeast. In search of economy, we conducted an 
analysis of major components of the BC process, hoping to identify dispensible 
aspects of school consultation. Specifically, we evaluated three increasingly 
inclusive versions of BC and a control group. 

Findings appeared contradictory. Teacher ratings indicated DTT students 

ERLC ^ 



Prereferral - 6 



in more- and most-inclusive versions of the model displayed greater social or 
academic improvement than those In least-inclusive BC and control groups. 
Direct observation of their classroom behavior, however, failed to produce 
similar between-group differences. Such inconsistency produced many, and 
sometimes conflicting, interpretations. Another disquieting finding involved 
the second stage of BC, in which MAT consultants participated as members of a 
multidisciplinary team comprised of the regular teacher and other 
building-based support staff. Its purpose was to engage in collaborative 
problem solving to develop effective interventions. To better understand the 
Year 1 data, the nature of these collaboratively developed interventions was 
analyzed. Whereas some were planned and implemented carefully, most reflected 
weak designs and/or were conducted inconsistently (see Fuchs & Fuchs, 1989 for 
details). 

MAT Research in Year 2 ( 1986-1987 ) 

Poorly conceptualized and/or executed interventions in Year 1 argued for 
strengthening their design and implementation. This was addressed (a) through 
selection of a limited set of interventions supported by research and (b) by 
development of prescriptive instruction? and materials to guide their use. By 
requiring MAT consultants to select among a small group of carefully detailed 
Interventions, we sacrificed some consultation-teacher autonomy and 
collaboration to help ensure accurate implementation of judiciously chosen 
interventions. In keeping with this more directive approach, the importance 
of the multidisciplinary team diminished, and it was eliminated in Year 2. 

We decided to conduct a second experimental investigation of the three BC 
versions. One reason was that, despite BC's widespread use, there are scant 
empirical studies supporting its conceptaO integrity. Validity studies such 
as component analysis are long overdue. A second, more practical reason 
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recognizes that many school consultants do not Implement all four stages of 
BC. Rather, they typically limit their activity to the first two stages; that 
is, helping teachers to define the problem and identify possible solutions. 
To our knowledge no previous study has explored the effectiveness of this 
popular, albeit abbreviated, BC version by comparing It to more complete BC 
variants and a control group. 

Although a second component analysis was planned, Year 2 research 
differed in important ways from the preceding year's effort. Impressed by the 
inconsistency of the teacher rating and observation data in Year 1, the 
research design was modified in several ways. We (a) explored the honesty of 
teacher ratings by comparing those communicated to consultants with those 
expressed anonymously; (b) requested teachers to complete a second, and very 
different, rating scale; (c) increased the frequency with which DTT pupils 
were observed; and (d) observed DTT students' peers for comparison purposes. 
Finally, in an attempt to link outcome with process, data were collected on 
the frequency and accuracy with which interventions were implemented. This 
article describes the Year 2 effort to develop, implement, and validate 
effective and "do-able" prereferral interventions across multiple classrooms 
and schools in a large urban school district. 

Method 

Setting 

Five experimental schools i^ere identified. Then, two control schools 
were selected that matched experimental schools on location (inner city) and 
level (middle school) as well as these five factors: (a) proportion of Black 
Suudents; (b) annual percentage of pupils referred for psychological 
evaluations; (c) average reading and math scores on the Stanford Achievement 
Test and a criterion-referenced test; (d) a composite index of a school 



10 



Prereferral - 8 



staff's likelihood to refer students for psychological evaluations; and (e) 
percentage of students receiving free lunch. As shown in Table 1, 
experimental and control schools were comparable on these dimensions. 



Insert Table 1 about here 



In contrast to other schools <n the district, the seven project schools 
enrolled an equal percentage of Black students and were associated with a 
similar annual rate of referral for psychological evaluations. Moreover, 
pupils in project schools earned reading and math scores comparable to fourth 
through eighth grade students in the school system. 
Participants 

Consultants . Eight school-based support staff were associated with the 
five experimental schools: five special education resource teachers; two pupil 
personnel specialists (PPS), a newly created postition requiring the 
assessment skills of a psychologist, advising capacity of a counselor, and 
family-work experience of a social worker; and one librarian. The two PPSs 
were formally trained and experienced school psychologists. In return for 
their project involvement, consultants received a small cash stipend. 

All consultants were female. One was Black; the remainder Caucasian. 
They ranged in age from 28 to 48 years (M « 40.50, SD - 8.43), had between 3 
and 18 years of experience as classroom teachers (M « 10.75, SD « 5.50), were 
in their present school from 1 to 6 years (M « 3.00, SD « 1.60), participated 
in 0 to 3 formal courses on teacher consultation (M « .88, SD « 1.25), and 
reported 0 to 40X (M « 11.80, SD ^ 12.90) of work spent in consultation. 
Their relatively infrequent consultation with classroom teachers reflects at 
least two facts: They were largely untrained and inexperienced in 
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consultation, and their work time was dominated by competing Job 
responsibilities. Special educators were required to maintain heavy 
direct- service caseloads; PPSs were expected to counsel students or families* 
conduct school -wide Job awareness and drug prevention programs, serve as 
attendance officers, etc. 

Four graduate students, three In special education and one In school 
psychology, also served as consultants. Each special education student was 
assigned one experimental school; the school psychology student, two schools. 
In addition to conducting teacher consultation, the four graduate students 
were trained to provide technical assistance to school-based consultants. 
They endeavored to make certain that the consultants (a) understood the 
consultation process and substantive nature of prescribed classroom 
Interventions, (b) had all necessary project-related materials, and (c) were 
proceeding with consultation In timely fashion, while collecting required 
student performance and fidelity of treatment data. In short, as dispensors 
of technical assistance, the graduate students were the on-site experts, 
facilitators, and building "cops" responsible for ensuring that project 
activities were completed with fidelity and timeliness. 

Project teachers . In experimental schools, consultants recruited 30 
fifth and sixth grade teachers and one seventh grade teacher, who met three 
criteria: First, they had at least one difficult- to- teach pupil at risk for 
special education referral or retention; second, they expressed willingness to 
participate In project activities; and third, they were perceived by 
consultants as Individuals with whom the consultants could work. Thus, 
teachers in experimental schools were not selected randomly; rather, as often 
happens in practice, they were identified as persons expressing a need for and 
willingness to participate in consultation. 
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In control schools, principals and project staff recruited 12 fifth and 
sixth grade teachers who, like the experimental teachers, had a 
difflcult-to-teach pupil and agreed to participate In project-related 
activity. On average, the 43 experimental and control teachers had taught 
12.91 years and currently had 24.56 students In v classroom; 36 and 7 were 
Caucasian and Black, respectively; and 33 were female. Experimental and 
control teachers received a small cash stipend for project participation. 

Difficult- t o- teach students . All project teachers Identified their most 
difflcult-to-teach (DTT) nonhandlcapped pupil. A majority of these 43 
students was boys (77t), In fifth {47S) or sixth (SIX) grade, and Caucasian 
(60t). Their teachers reported them reading at a median 5.02 grade equivalency 
In the Ginn 720 reading series. A total of 30X previously had been held back 
at least one grade. Additionally, 53X were described as DTT primarily because 
of "off task" or "Inattentive" behavior; 21% as a result of "poor 
Interpersonal skills with adults"; 19X because of "poor academic work," 
despite an ability to perform better; and 7X because of "Intrapersonal 
characteristics" such as low motivation or because of "insufficient academic 
skills." (For a more detailed description of these DTT pupils, see Bahr, 
Fuchs, Stecker, Goodman, i Fuchs, 1988.) 
Description of Contrasting Versions of BC 

The Importance of various components of the BC model waS explored by 
creating three Increasingly Inclusive versions. In the least Inclusive 
variation, (Problem Identification and Problem Analysis) (BC^), consultant 
and teacher worked collaboratively to identify and analyze the problem. The 
consultant, however, did not assist the teacher's Implementation of the 
Intervention. Moreover, consultant and teacher did not evaluate Intervention 
effects In a formative fashion, precluding opportunity for "fine tuning" the 
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Intervention. 

The second variant of BC (Problem Identification, Problem Analysis, and 
Plan Implementation) (BC also Included the first two stages. Additionally, 
It required the consultant to make a minimum of /io classroom visits, during 
which the consultant observed the teacher Implement the Intervention, and to 
provide corrective feedback. However, like the first version, this second 
variation of BC did not include a formative evaluation stage. Finally, our 
third and most inclusive version (BC2) Incorporated the first three stages 
(Problem Identification, Problem Analysis, and Plan Implementation) as well as 
required consultant and teacher to formatively evaluate intervention effects. 
Written Scripts 

All but one stage (i.e., plan implementation) were conducted during 
formal interviews or meetings. Inspired by the CantreU's Heuristic Report 
Form (see Cantrell & Cantrell, 1977; 1980), we recast descriptions by Bergan 
(1977), Gresham (1982), and Witt and Elliott (1983) of the substance covered 
In these formal meetings into written scripts, which guided much of the 
consultants' verbal behavior. Our expectation was that scripts would help 
consultants (a) create a rationale and overview for the meetings; (b) 
establish and maintain a logical and quick-paced "flow"; (c) obtain 
descriptions of the classroom environment, evaluations of targeted students, 
and important logistical information; and (d) systematically check the 
accuracy of key information. 

In addition to promoting efficiency, we believed scripts might enhance 
fidelity of treatment. In other words, assuming (a) scripts accurately 
reflected the BC model and (b) consultants faithfully followed them, we could 
be confident the model was implemented accurately and in a standard manner. 
(See Kratochwill, 1985 and Kratochwill & Van Someren, l^ou on the importance 
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of conducting BC in standard fashion,) This fidelity of treatment issue was 
especially important since most MAT consultants lacked formal consultation 
training and experience. Mindful of this» the tour graduate students assigned 
to the experimental schools were instructed to encourage the school-based 
consultants to follow the scripts with fidelity as well as record the degree 
of accuracy with which scripts in fact were used. Each BC version had its own 
script. 

Prereferral Intervention 

Teacher-student contract . A teacher-student contract was selected as an 
intervention strategy for two related reasons: First, a majority of 
teacher-consultant pairs independently decided to use it during Year 1 (see 
Fuchs ft Fuchs, 1989). Second, recent surveys (e.g., Martens, Peterson, Witt, 
& Cirone, 1986) indicate it Is viewed positively by a large proportion of 
classroom teachers. The contract stipulated six dimensions of treatment: (a) 
type and degree of desired change in social or academic behavior; (b) 
classroom activity to which the contract would apply; (c) the strategy by 
which behavior would be monitored; (d) the nature of reward; (e) when and by 
whom the reward would be delivered; and (f) whether the contract could be 
renegotiated. Teachers were given blank copies of contracts. Attached was a 
message reminding them that activity, material, and token rewards are 
demonstrably effective in helping many DTT students improve their attitude and 
overt behavior. 

To enhance the salience of these rewards, consultants encouraged teachers 
to base the nature of the reward on student interests and to award reinforcers 
as soon as possible following demonstration of desired behavior. Each 
contract was good for only one day. Teachers were required to use them for at 
least 3 weeks: Every day during the first week; a minimum of two tir:,es during 
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the second and third week. Thus, across the 3 weeks as well as 6C groups, 
teachers were to use the contracts for a minimum of 9 days. 

Konltoring behavior and academic performance . While blocking for 
membership In 6C 1, BC 2, and 6C 3, the 31 teachers were assigned randomly to 
either a student- or teacher-monitoring group. Sixteen were directed to 
monitor student performance; 15 were trained by consultants to Instruct their 
DTT students to monitor themselves. Also, depending on the nature of the 
problem behavior , monitoring procedures Involved either Interval recording or 
product Inspection. Interval recording was defined as a "monitoring technique 
used to record whether a social behavior does or does not occur during a 
predetermined period or Interval." Consultants recommended use of Interval 
recording when student behavior was primarily disruptive to the teacher's or 
classmates' work or well-being (such as disturbing noise or Inappropriate 
touching of others). Building on work by Hallahan and associates (e.g., 
Hallahan, Lloyd, Koslewicz, Kauffman, & Graves, 1979; Hallahan, Marshall, & 
Lloyd, ISol), we developed directions and monitoring forms to guide students' 
(or teachers') use of Interval recording. 

Essentially, this procedure Involved use of an audiotape, which played 
soft "beeps" both to signal the end of each recording interval and to prompt 
the DTT student (or teacher) to place a plus (+) or minus (-) sign In a 
corresponding place on the monitoring sheet. To record a pi us , the student 
either (a) displayed the target behavior when the situation called for It, or 
(b) refrained from displaying It when It would have been Inappropriate to do 
so. Before recording a minus , the student either (a) did not display the 
target behavior when It would have been appropriate to display It, or (b) 
exhibited the behavior when It was Inappropriate to do so (see Fuchs, In 
press, for details) . 



Prereferral - 14 



Product inspection was defined as "evaluation of academic work at the end 
of a predetermined duration/ This form of monitoring was used for behaviors 
primarily interfering with the student's own academic work (such as 
inattentiveness and frequent getting out of seat). As with interval 
recording, teachers and students were required to adhere to specific 
guidelines, and special monitoring sheets were created to facilitate record 
keeping (see Fuchs, in press). 
Training 

In two all-day sessions totalling 16 hours, consultants were trained in 
three areas. First, the probleirhsolving, collaborative, and data-based nature 
of BC was discussed. To improve understanding of these features, consultants 
role played within the context of several prepared vignettes and received 
corrective feedback. Second, using videotapes of actual classroom conflict, 
they were tra^'ned to employ reliably a systematic observation procedure. 
Third, consultants were introduced to the teacher- student contract and 
Interval recording and product inspection monitoring procedures. They became 
familiar with the monitoring sheets, were taught when to use interval 
recording and when to use product inspection, and were informed how contracts 
and monitoring activities fit within the larger context of BC. 
Assignment of Teac hers and Scripts to Consultants 

Assigning teachers . On the second day of training, consultants were 
grouped by school and provided a list of teachers in their respective 
buildings who had volunteered for the project. To help ensure an equitable 
distribution of comparatively strong and weak teachers among all consultants, 
the school-based consultants rated each teacher's "demonstrated ability and 
willingness to work with difficult- to- teach students," using a 6-point 
Likert-type scale (6 - "very high"; 1 « "very low"). With these ratings as a 
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gu1de» each of the eight school consultants then chose two general educators 
with whom to consult and assigned the remlnlng IS experimental teachers to 
the four graduate students. Teachers deliberately were not assigned randomly 
to consultants because many school consultants worked as members of 
well-defined teacher teams responsible for regular planning and monitoring of 
school activities; to have paired them with teachers not part of their team 
would have been to Introduce burdensome logistical complications. 

Assigning scripts . He did randomly assign experimental teachers to the 
three 6C versions, with 10» 10» and 11 teachers assigned to BC 1, BC 2, and BC 
3, respectively. On the 6-po1nt rating scale, consultants assigned BC 1, BC 
2, and BC 3 teachers average ratings of 4.50, 4.40, and 5.09, respectively, £ 
(2, 28) « 1.10, ns. Table 2 displays teachers' class size, race, gender, and 
years of professional experience by the three BC variants, as well as for the 
12 control teachers. As Indicated In Table 2, the groips were not reliably 
different on any dimension, except gender; there was a greater proportion 
males In BC 2 than In the other groups. 



Insert Table 2 about here 



Table 2 also provides Information by experimental and control groups for 
chronological age, grade level, and percentage Black, male, and retained at 
least 1 year. There was a larger proportion of Black students In BC 1 than In 
other groups. All student groups were comparable on the remaining dimensions. 
To guard against subject loss, we recruited slightly more teachers and 
students than the desired n of 10 per group. Because no attrition occurred, 
we were left with the unequal group sizes displayed In Table 2. 

Random assignment of teachers to scripts meant that most consultants used 
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one form of BC with one teacher and a contrasting variant with another. 
Consultants were Informed that there was no compelling a priori reason to 
believe that one script would be more effective than another and» 
consequently, It would be a mistake for them to anticipate which script would 
prove more effective. 

Following training each consultant was given a spiral-bound notebook, 
Including: (a) written scripts for every teacher and meeting; (b) classroom 
observation forms and worksheets to direct calculation of percentage of 
displayed targeted behavior; (c) copies of the teacher- student contract; (d) 
description of various reinforcement strategies teachers might Incorportate 
Into contracts; (e) an outline of the Interval recording and product 
Inspection monitoring procedures; (f) multiple copies of the two types of 
monitoring sheets; and (g) a detailed timeline encouraging consultants to 
conduct project activity In timely fashion. 
Consul tatlon Procedure 

Figure 1 displays sequences of salient consultation activity associated 
with the three versions of BC. BC 1 (least Inclusive sequence) differs from 
BC 2 and BC 3 (most Inclusive sequence) In Its omission of classroom 
visitations. The uniqueness of BC 3 In relation to BC 2 Is BC 3's potential 
for a third classroom visit, fourth meeting, and fifth observation. 
Consultants conducted all observations except the follow-up observations, 
described below. The first two helped validate as well as establish a 
"baseline" for teacher- identified problem behavior. As depicted In Figure 1, 
Observations 3 and 4 (and Observation 5 In BC 3) were conducted following 
completion of the Intervention and were used to assess Its effect. Figure 1 
also Indicates that BC 1 and BC 2 called for 6 weeks of consultation, whereas 
BC 3 required a maximum of 8 weeks. 
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Insert Figure 1 about here 



Measures and Data-Collectlon Procedures 

Measures and data-collection procedures included fidelity of treatment 
indices as well as direct observations of DTT students' and peers' classroom 
behavior, two types of teacher ratings, questionnaires for students, teachers, 
and consultants, and debriefing interviews with consultants and teachers. 
Such measures and procedures constituted a modest multi-method, multi*person 
approach to MAT evaluation. 

Fidelity of treatment > Each day on which the teacher- student contract 
was implemented the student (or teacher) completed a monitoring sheet. As 
indicated, there were two types: interval recording and product inspection. 
Interval recording forms required: (a) the student's name, (b) the class 
activity during which monitoring occurred, (c) the target behavior, (d) the 
duration of the recording period, and (e) a tally of minus (-) or plus {^) 
signs, recorded in a grid of cells representing monitoring intervals, to 
indicate whether or not target behavior was displayed. Finally, the 
monitoring sheet guided students' (or teachers') calculation or the percentage 
of intervals during which target behavior occurred. 

Product inspection fc/ms required specification of (a) the product (e.g., 
math worksheet), (b) the number of minutes permitted for work completion, (c) 
the evaluative criteria including quantity (i.e., amount of work to be 
completed) and quality (i.e., percentage of work to be completed correctly) 
indicators, and (d) a record of actual performance with respect to these 
criteria. Last, these monitoring sheets requested teachers to indicate 
whether the student met the amount and quality criteria. 
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Following completion of project activity, trained graduate students 
Inspected DTT students' interval recording or product inspection monitoring 
forms and rated each set on these dimensions: (a) total number of monitoring 
sessions initiated and the number Initiated during weeks, 1, 2, and 3; (b) 
percentage of sessions completed; and (c) percentage of monitoring forms 
completed with lOOS accuracy. Across these dimensions, interrater agreement 
ranged from 88t to lOOX. 

Observations . The observation procedure combined features of 
time-interval recording and anecdotal note taking on antecedents and 
consequences to the target behavior (see Fuchs, in press, for details). 
Consultants, who conducted all observations except at follow-up, were 
instructed by audiotape to observe the DTT student and two randomly selected 
same-sex peers on a rotating basis for 2-minute intervals. During the first 
interval, consultants observed the DTT pupil; during the second, peer 1; 
third, the DTT student; fourth, peer 2; fifth, the DTT pupil, etc. Each 
2-minute interval was divided into 10-second blocks for observing (8 seconds) 
and recording (2 seconds). Students were observed during 30-minute sessions, 
twice preceding intervention and two times immediately after completion. 
Three weeks following post-observations, they were observed once more by a 
trained research assistant. Thus, DTT students and peers were observed at 
least five times (and possibly six times in EC 3). Observations focused only 
on DTT pupils' target behavior. 

Following 6 hours of training with interval recording, school-based and 
graduate student consultants demonstrated interrater agreement of .91, which 
was calculated by dividing the number of agreements by agreements plus 
disagreements on an interval-by-interval basis. Two "blind" observers were 
matched with consultants for 21% of pre-observations and 33% of 
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post-observations. Mean Interrater agreement was .93 and .94, respectively. 
Disagreements were resolved through subsequent discussion. (See Fuchs, In 

press, for more detailed description of the observation procedure.) 

I 

Teacher ratings . Each experimental and control teacher Identified 4 to 6 
problematic social or academic behaviors of their DTT student. One became the 
focus of prereferral Intervention, to which we have already referred as 
"target behavior." Using a 5-po1nt Llkert-type continuum, teachers rated each 
behavior In terms of severity (1 « severe, 5 « mild), manageability (1 « 
unmanageable, 5 * easily managed), and tolerablllty (1^ Intolerable, 5 - 
Intolerable). Selection of these scales was based partly on Safran and 
Safran's work (1985), suggesting their Importance In understanding teacher 
perceptions of problem behavior. Experimental teachers provided ratings prior 
to and Immediately following Intervention. Control teachers' pre- and 
postratlngs were obtained at the same time. In prior related research (Fuchs 
i Fuchs, 1989), the Internal consistency (Cronbach's alpha) of these ratings 
at pre- and post-Intervention has been .93 and .92, respectively. 

Concurrent with completion of the postratlngs, all teachers responded to 
a questionnaire, which Included a second post- Intervention rating. Teachers 
were Informed that, unlike the previous two ratings, this rating was 
anonymous. Thus, they were asked not to place their names on the 
questionnaires. In fact, we ensured the anonymity of Individuals ; but, by 
secretly marking the questionnaires, we Identified respondents by group 
assignment. This procedure (approved In writing prior to Implementation by 
the university's Committee for the Protection of Human Subjects) provided 
opportunity to compare "public" and "private" ratings, thereby helping to 
determine the frankness of teacher ratings obtained by consultants. 

Revised Behavior Problem Checklist (RBPC). The RBPC (Quay & Peterson, 
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1983) was completed by teachers on their DTT pupils prior to and Immediately 
following Intervention. The RPBC contains 89 Items, 77 of which constitute 
six Independent scales: Conduct Disorders , representing a dimension of 
aggressive, noncompllant, quarrelsome. Interpersonal ly alienated, acting-out 
behavior; Socialized Aggression , which measures a rejection of authority; 
Attention Problems , reflecting problems In concentration, perseverance, 
Impulslvlty, and direction- following; Anxiety Withdrawl , subsuming 
characteristics of anxiety, depression, fear of failure, social Inferiority, 
and self-concern; Psychotic Behavior , relating to overt psychosis and related 
language dysfunctions; and Motor Tension-Excess , Involving gross motor 
behavior and motoric tension. 

Teachers rated the RBPC Items on a 0 to 2 scale after consultants read 
them standard Instructions. Reliability and validity of the RBPC appear 
comparable to or better than those of most behavior rating scales (Ellason i 
Richman, 1988): Interrater agreement ranges between .52 and .85; 2-month 
test-retest reliability Is between .49 and .83; and there Is evidence of 
concurrent validity with several DSM-III diagnoses, peer nominations, and 
direct observations (see Quay i Peterson, 1983; 1987). 

Questionnaires . Following completion of the Intervention the graduate 
student consultants administered questionnaires Individually to teachers and 
students In BC 1, BC 2, and BC 3, and to the school-based consultants. Items 
explored respondents' views on project effectiveness, the relative Importance 
of facets of the Intervention, degree of difficulty associated with 
Implementing the Interventions, etc. Each Item was rated on a 5-po1nt 
Llkert-type scale. 

Debriefing Interviews . Several weeks after administration of the 
questionnaires, school-based and graduate student consultants In the same 
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schools were interviewed together. The five separate debriefing sessions 
lasted between 30 and 90 minutes, with 2 to 4 consultants participating. 
Consultants were encouraged to offer candid impressions of the project, 
including ways in which it might be enhanced. Seven randomly chosen 
experimental teachers also were interviewed. These sessions, too, were 
open-ended and meant to provide teachers a chance to "speak their minds." 
Data Analysis 

Two points require clarification regarding data analysis. First, as 
mentioned, the eight school-based consultants and four graduate students 
worked with 16 and 15 teachers, respectively. To explore whether type of 
consultant (i.e., school-based vs. graduate student) exerted systematic 
effects on any outcomes, a series of analyses was conducted. In each 
analysis, the consultant factor was not significant. Thus, it was eliminated 
from subsequent analyses. Second, data obtained from all measures, but one, 
were subjected to statistical analysis. The exception was the questionnaire, 
from which only descriptive data are presented. This is because most items 
were dissimilar across types of respondent, precluding straightforward 
comparisons. 

Results 

Fidelity of Consultation Process 

As described abovec the BC 3 process is different from that of BC 2 
because it includes a formative evaluation component. This requires teacher 
and consultant in Meeting 3 to measure the student's current performance level 
against a goal set in Meeting 1. Moreover, if consultant and teacher decide 
that this goal has not been reached, then they must change the student goal, 
modify the intervention, or both. In the case of a changed goal or modified 
intervention, the consultant conducts a third classroom visit, fourth meeting. 
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and fifth student observation, none of which is part of BC 2. On the other 
hand, if the consultant- teacher team determines that the goa. Jjas been 
attained, or, if not attained, that sufficient progress has been demonstrated, 
then consultation is terminated. In this case, BC 3 is much like BC 2. All 
this prompts the question, ''How many consultant* teacher dyads in BC 3 
determined that changes in goal and/or intervention were necessaiy?" Answer: 
none. Although two teachers claimed initial goals had not been met, both 
expressed satisfaction with student progress. Thus, aside from the fact that 
BC 3 participants formally compared students' current level of performance to 
initial goals, there was little to distinguish BC 3 members' activity from 
that of BC 2. 

Fidelity of Classroom Interventions 

Monitoring ; Teacher versus student; interval recording versus product 
inspection . Half the teachers in BC 1 and BC 2 monitored DTT students' 
behavior, while the other half taught the DTT students to assume tf-' task. 
In BC 3, 6 and 5 teachers were involved in teacher and student monitoring, 
respectively. As reported elsewhere (Fuchs, in press), teacher versus student 
monitoring did not produce any reliable differences and will not be discussed 
further. In BC 1 and BC 2, 7 of 10 teacher- student pairs used product 
inspection; in BC 3, 7 of 11. Thus, across the three experimental groups, 
virtually identical proportions of teacher- student pairs used product 
inspection, T (2, ji « 31) « .13, n^* and, for this reason, type of monitoring 
procedure (interval versus product inspection) was not explored further. 

Monitoring : Frequency and accuracy . Means in Table 3 indicate teachers 
and students in the three experimental groups complied with the requirement 
that contracts and monitoring should be implemented a minimum of S times 
across three weeks. Moreover, on average, they satisfied the related request 
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that they monitor behavior or academic performance a minimum of 5, 2, and 2 
times during week 1» 2» and 3» respectively. Additionally, the table shows 
that teachers and students completed monitoring tasks In a thorough manner and 
with a relatively high degree of accuracy. 
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A one between (BC 1 vs. BC 2 vs. EC 3) one within (number of sessions vs. 
percent complete vs. percent perfect vs. percent components correct) ANOVA, 
with repeated measu'^es on the second factor, Indicated (a) no significant 
effect for the experimental factor, F (2, 28) » 1.96, but (b) a significant 
effect for the fidelity scale factor, which was due to contrasting metrics for 
the different fidelity Indices. Therefore, no follow-up analyses were 
conducted. Additionally, there was no significant Interaction, £ (6, 84) - 
1.79. 

A second one between (BC 1 vs. BC 2 vs. BC 3) one within (week 1 vs. 
week 2 vs. week 3) ANOVA, with repeated measures on the second factor, 
Indicated no significant effect for experimental group, £ (2, 28) « .18, and 
no significant Interaction between experimental group and week of 
Implementation, £ (4, 56) « .65. There was a significant effect, however, for 
the week factor, £ (2, 56) « 43.29, £ < .001. A series of paired t tests 
revealed that the number of monitoring sessions Implemented during week 1 was 
greater than In week 2 (t (30) « 8.24, £ < .001) and week 3 {t (30) « 6.86, £ 
< .001). There was no reliable difference between weeks 2 and 3. 

Frequency with which contractual goals were met . On average, pupils In 
experimental groups achieved their dally contract-related goals during a 
majority of the monitoring sessions: 66% (SO « 31) for BC 1; 62% (SD « 31) for 
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BC 2; and 72X (SD « 19) for BC 3. A one between ANOVA (BC 1 vs. BC 2 vs. BC 
3) Indicated these proportions were not reliably different* £ (2, 18) > .78. 
These data are based on the 21 DTT students (7 per experimental group) 
Involved In product Inspection. 
Observations 

Table 4 d1^^>1ays (a) percentages of Intervals during which DTT students 
and peers demon situated TB and (b) discrepancies between therr at pre- and 
post-observation and follow-up (see Figure 2). A three-way ANOVA revealed a 
group by stiKlent (DTT vs. peers) by tr<al Interaction, F (6, 78) = 5.42, £ < 
.001. Scheffe analysis Indicated tha:, from pre- to-post-observation, 
reductions In the DTT student- peers discrepancy wen. reliably greater for BC 2 
(M « .30) and BC 3 (M « .28) than for BC 1 (M « .13) and controls (M « .02). 
No group demonstrated significant behavior change from post- Intervention to 
follow up. 



Insert Table 4 and Figure 2 about here 



Teacher Ratings 

Table 5 presents means and standard deviations of teacher ratings for BC 
and control groups and pre, post, and anonymous trials. A two-way ANOVA 
Indicated a significant effect for the group by trial Interaction, £ (6, 78) « 
3.34, £ < .01. Figure 3 displays this Interaction. Scheffe analysis showed 
that changes between pre- and post- Intervention ratings for BC 1, BC 2^ and BC 
3 were reliably greater than for controls (see Table 5). There was no 
reliable pre- to post-Intervention change between BC 1, BC 2, and BC 3, or 
between post- Intervention and anonymous ratings across BC groups and between 
BC and control groups. 
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Insert Table 5 and Figure 3 about here 



Revised Behavior Problem Check! i^^ 

N^ians and standard deviations of teacher responses on the RBPC are shown 
In Table 6. A group by scale by trial MANOVA produced a significant effect, F 
(10, 120) « 2.16, £ < .05. One-way ANOVAs on each RBPC scale revealed the 
following: F (3, 42) « 3.95, £ < .05 for Conduct Disorders; F (3, 42) « 2.01, 
ns for Soclallzecf Aggression; F (3, 42) - 2.73, £ « .057 for Attention 
Problems-Immaturity; F (3, 42) = 1.22, ns for Anxlety-Withdrawl ; F (3, 42) « 
1.05, ns for Psychotic Behavior; and F (3, 42) « .89, ns for Motor Excess. 



Insert Table 6 about here 



For Conduct Disorders, follow-up analysis revealed that (a) ratings 
became significantly more positive from pre- to post-Intervention for pupils 
In BC 2 than for controls and (b) for Attention Problems-Imr.iatur1ty, teacher 
ratings became more positive from pre- to post-Intervention for students In BC 
1, BC 2, and BC 3 than for controls. Pre- and post- Intervention responses to 
Conduct Disorders and Attention Problems- Immaturity Items of the RBPC are 
Illustrated In Figure 4. 



Insert Figure 4 about here 



Teacher, Consultant , and Student Questionnaires 

Project effective ? Across BC groups, mean teacher ratings of project 
effectiveness ranged from 3.00 to 3.82 on a 5-po1nt scale (see Table 7). 

28 
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Ratings of 3.30 to 3.64 Indicate teachers judged project activities "do-able." 
Consultant ratings of project effectiveness ranged from 3.20 to 3.82. Their 
ratings of project components like student- teacher contracts (4.10 to 4.20) 
and monitoring procedures (4.50 to 4.60) also were positive. Students (a) 
believed their behavior Improved during the contracts (3.80 to 4.30), and (b) 
stated they would recommend that more teachers use them (3.80 to 4.50). 
Moreover, students believed their rewards were Important (3.90 to 4.20), 
contracts were fun (3.90 to 4.45) and fair (4.10 to 4.82), and they worked 
hard on them (3.45 to 4.20). 



Insert Table 7 about here 



Project worth doing? Table 7 suggests that, regardless of group, 
teachers tended to be'^leve the project was worth dolog, with mean ratings 
ranging from 3.90 to 4.36. They also appear more than less likely both to 
continue to use the Intervention next year (3.20 to 3.60) and to volunteer for 
the project again (3.00 to 3.60). (k)nsul tants, too, seemed to believe the 
project was worthwhile, with ratings between 4.10 and 4.20. With ratings 
between 3.45 and 3.80, they also Indicated that project parf^lpatlon 
contributed to their professional development. 

(^nsultants collaborative and technical as si stance helpful? Teachers 
assigned their highest ratings to Items concerning consultants. They believed 
consultants were very collaborative (4.00 to 5.00) and very helpful (4.20 to 
5.00). To the question, "How supportive was the technical assistance 
available to you?," each consultant responded with a rating of 5. 
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Component Analysis 

More is better . Findings from the component analysis suggest the more 

Inclusive versions of BC 2 and BC 3 promoted more positive student change than 

the least Inclusive variant, BC 1. Pre- and post-observations of classroom 

behavior buttress this view. In comparison to DTT students In BC 1 and 

control groups, BC 2 and BC 3 pupils significantly reduced initial 

discrepancies between themselves and their peers regarding percentage of 

problem behavior. BC 1 and control students did not differ in this respect. 

Moreover, these results were uncharged at "follow-up," 3 weeks after 

termination of formal interventions. Corroborating these data were responses 

to the RBPC, indicating BC 2 teachers perceived significantly greater 

reductions of Conduct Disorders than did other teachers. 

Adding incisiveness to the component analysis are the fidelity of 

treatment data. They (a) substantiate that students and teachers in BC 1, BC 

2, and BC 3 implemented the interventions with similar frequency, 

thoroughness, and accuracy, and (b) strengthen the conclusion that group 

differences in DTT students' classroom behavior and their teachers' 

perceptions of conduct disorders were due to variations in the consultation 

process , not quci»^titative or qualitative differences in classroom 

interventions . 

Implications ^or theory and practice . These findings are important 
theoretically because they represent pr ^minary validation of the BC model; 
that is, they represent tentative affirmation of its integrity by upholding 
the central assumption that its components are important and additively 
related. Practically speaking, however, the "more is better" conclusion is 
troubling. Effectiveness aside, more inclusive versions of BC require more 
time and energy from school personnel and, therefore, are less likely to be 
seen as feasible. Underscoring the seriousness of this point is that 
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relatively few school districts and building principals permit special 
educators and school psychologists opportunities to consult with classroom 
teachers (e.g., Gutkin ft Curtis» 1982; Idol-Maestas ft Ritter, 1985; Nevin, 
Paolucci-Hhitcomb, Duncan, ft Thibodeau, 1982). 

On the other hand, MAT consultants reported that, on average, 
participation in BC 2 and BC 3 versions required 6 hours of their time per DTT 
pupil. In light of demonstrated effects on student behavior and teacher 
perceptions, this time expenditure seems small. MAT consultants' efficiency 
becomes even more apparent when their 6-hour estimate is compared to the fact 
that it typically takes school psychologists in the same district twice as 
long to administer, score, and write a single psychological evaluation 
(Director of Psychology, personal communication, June, 1987). We join Idol 
(1988) and others in suggesting that district officials and building 
principals can be sold on the econorry and effectiveness of certain types of 
consultation-related activity. 

In a related vein, anovher finding from our component analysis indicates 
that, whereas more inclusive BC versions may be more effective, conducting a 
BC 1 version may be better than doing nothing at all . Three types of data 
support this view. First, analysis of teachers* pre- and post-intervention 
(severity, manageability, and tolerableness) ratings of target behavior 
indicated (a) students in BC 1, BC 2, and BC 3 received significantly and 
dramatically more improved ratings than controls, whereas (b) there was no 
discernable difference in changed ratings among the three experimental groups. 
This pattern held irrespective of whether teachers expressed their ratings 
publicly or anonymously. 

Second, BC 1, BC 2, and BC 3 teachers registered similar and dramatically 
more positive ratings of their DTT students from pre- to post-intervention on 
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the Attention Problems scale of the RBPC. Third » the Importance of BC 1 (as 
well as BC 2 and BC 3) Is Indicated by questionnaire data. This "consumer 
satlsf^^ctlon** Information reflects generally positive sentiments about the 
project's effectiveness, value, "do-ableness," and fairness, across 
respondents and BC groups. Assuming that special educators' and school 
psychologists' typical consultation activity resembles BC 1, findings 
represent both good and bad news: Whereas conventional practice probably Is 
beneficial. It seems less effective than It could be. Results Indicate that 
school consultants should Implement more complete versions of the consultative 
process. 

Study Limitations 

Prereferral Interventions . The apparent effectiveness of MAT prereferral 
Interventions precluded an opportunity to conduct a more complete component 
analysis of BC. That Is, since none of the teacher-consultant teams In BC 3 
decided that a modified Intervention was necessary, there was little to 
distinguish BC 2 and BC 3 activity. For all practical purposes, then, this 
component analysis only pitted BC 1 against BC 2 and BC 3. The Irony Is that, 
whereas the component analysis of Fuchs and Fuchs (1989) was compromised by 
many weak MAT Interventions, the current analysis Is rendered Incomplete 
because of relatively strong ones. 

One reason for the effectiveness of the Interventions In this study may 
be the high fidelity with which they were conducted. Fidelity of 
Implementation, In turn, probably was enhanced by the on-site presence of the 
four graduate students. As already mentioned, these students provided 
technical assistance and served as gophers and calendar-watchers, responsible 
for facilitating correct and timely Implementation of project activity. Would 
the MAT approach to prereferral Intervention have worked as well without this 
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on-site supervision? Probably not. Thus, we believe It would be a mistake 
for school administrators to assume that successful adoption of the MAT hinges 
only on acquiring the right directions and materials. Oversight of the type 
exercised by the graduate students, we believe, may be Important. It Is also 
costly. To help ensure successful adoption of MAT-type activity, some 
districts may be required to allocate resources accordingly. 

Another reason for the apparent success of the MATs may be Its 
prescriptive nature. Not only did written scripts guide the process of 
consultation, but teacher- student contracts and student monitoring forms 
determined much of the substance of the In-class Interventions. This 
prescrlptlveness sets the MATs apart from typical practice (cf. Friend, 1985; 
Johnson, Pugach, i Hammlttee, 1988; Relsburg & Wolf, 1988), a point to which 
we win return. The reader should recognize that this divergence, however 
Justifiable, represents an additional constraint on the generallzability of 
findings. 

Subject selection . Another Important departure from typical practice was 
that, rather than wait for teachers to request help, our 12 consultants 
actively recruited teachers with DTT pupils to participate. This unusually 
''proactive" consultant behavior raises the question whether the recruited 
teachers and students are typical of those who normally participate in 
consultation activity. Additionally, although consultants were assigned 
randomly to experimental groups, they were not assigned randomly to teachers. 
Rather, they carefully selected teachers from a pool of prospective consul tees 
whom they knew well. Moreover, the teachers were volunteers who, like the 
consultants, had been promised a small cash stipend as quid pro quo for study 
participation. All these facts probably represent limits on the exernal 
validity of the investigation. 
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Measures , Whereas observation, rating, and questionnaire data suggested 
DTT students Improved because of project activity, the study Is st111 missing 
a '"bottom line"" Index; namely, percentages of pupils In the three BC groups 
and control condition who were referred by their teachers for formal 
psychological evaluation. Moreover, there was little effort to ascertain the 
extent to which MAT effects maintained for longer than 3 weeks. Our 3-week 
follow-up, while probably better than no follow-up, does not substitute for 
long-term evaluation of MAT effectiveness. 
MAT Prescrlptlveness 

Without minimizing the Importance of the foregoing constraints and 
caveats, findings suggest the effectiveness of a prescriptive approach to 
prereferral Intervention and school consultation. As Indicated, MAT 
prescrlptlveness olffers from a currently popular view that consultation 
should be "collaborative," representing a reclpror^^i arrangement "that enables 
people with diverse expertise to generate creative solutions to mutually 
defined problems" (Idol, Paolucci-Whitcomb, i Nevin, 1986, p. 1). Thus, we 
suspect our directive approach may be viewed as an oddity by some researchers 
and practitioners with interest in consultation-related school activity. 

Nevertheless, we did not set out to Implement prescriptive prereferral 
Interventions. During Year 1, MAT consultants received Intensive training in 
collaborative consultation (see Fuchs, in press; Fuchs & Fuchs, 1989). 
Despite expectations for success, in-class interventions were largely 
unimpressive. Further, during project implementation and subsequent 
debriefing interviews, many teachers complained that they lacked time to 
"philosophize" about their DTT students. Instead, they wanted helpful 
suggestions. Contrastingly, during debriefings and on questionnaires 
administered after more directive Year 2 activity, teachers from the same 
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school district expressed satisfaction with the MAT Interventions and 
consultation process. No one described the project experience as coercive or 
Implicitly denigrating of his or her knowledge or skill. 

Our MAT experience suggests that the form and substance of consultation 
should be consonant with the specifics of the situation (cf. Heron ft Kimball, 
1988). In schools In which stress Is high, expertise In consultation Is low, 
and consultation time Is non-existent, prescriptive approaches appear better 
suited for success than collaborative ones. We have no doubt that. In 
different situations, more collaborative approaches may represent a better 
choice. Moreover, situations change. As teachers and support staff as well 
as school administrators become more experienced, confident, and positive 
regarding consultation-related activity, prescriptive approaches might give 
way to more collaborative efforts. We concur with a pragmatic view expressed 
by Friend (1988), Heron and Kimball (1988), Safer (1987), and others that the 
nature of consultation activity should be determined more by the circumstance 
in which consultants find themselves than by an a priori belief system. 
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Table 1 

Experimental (n « 5) and Control (a « 2) School Characteristics 



Experimenta l Control 



Variable^ 


M 


(SD) 


M 


(SD) 


F (1, S)^ 


Percentage Black 


36.42 


(6.65) 


42.25 


(19.16) . 


0.45 


Percentage referred 


5.29 


(1.22) 


5.13 


(0.41) 


0.03 


SAT-R 


fiAH fin 


19. Cv 1 


nn 

000 • uu 




U. 91 


SAT-M 


652.20 


(6.69) 


645.50 


(2.12) 


1.75 


BSF-R 


68.80 


(2.88) 


68.70 


(0.85) 


0.02 


BSF-M 


62.64 


(3.53) 


60.15 


(5.59) 


0.55 


Psychologist rating 


38.80 


(8.26) 


27.50 


(6.36) 


2.91 


Percentage free lunch 


38.16 


(6.37) 


29.02 


(0.29) 


3.68 



•SAT-R and SAT-M are the Reading and Math tests, respectively, of the 
Stanrord Achievement; Test. Form F Is administered district wide to second, 
fifth, seventh, n1ni;h, and twelfth graders. Data are scaled scores, with a 
maximum of 800. BSF-R and BSF-M denote the Basic Skills First tests In 
reading and math, respectively. BSF Is a state developed criterion- 
referenced Measure administered to students In third, sixth, and eighth 
grades. Data are percentages of Items correct. Psychologist Rating Is a 
composite index of a school's likelihood to refer pupils W psychological 
evaluations. It comprises 10 factors. Identified by the district's school 
psychologists. Including (a) building support staff's willingness to consult 
with teachers, (b) frequency of parental requests for special services, (c) 
teachers' ability and willingness to individualize instruction, and (d) 
teachers' knowledge of the district's referral procedure. Using a 5-point 
Likert-type scale, yielding a maximum (most desirable) score of 50 (5 points 
X 10 factors), 23 school psychologists rated the faculty of each building in 
the district. (Copies of this rating form may be obtained from the 
authors.) 

'^None of these F values is statistically significant. 
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Table 2 

Teacher and Student Deinogra;''.1c Data by Treatment Group 



BC 1 (n » 10) BC 2 (g « 10) BC 3 (tt « 11) Controls (n ' 12) 



Variable 


M 


(SO) 


M 


(SO) 


M 


(SO) 


M 


(SO) 


F (3. 39) >2(3) 


Teacher 




















Class sizi (# pupils) 


22.40 


(8.36) 


24.40 


(6.13) 


24.09 


(6.07) 


26.92 


(4.62) 


0.96 


Percent Black 


30.00 




20.00 




0.00 




20.00 




3.62 


Percent male 


20.00 




60.00 




0.00 




17.00 




11.25* 


Professional 




















experience (years) 


14.30 


(8.79) 


12.50 


(8.53) 


12.73 


(7.20) 


12.25 


(6.22) 


(0.15) 


Student 




















CA 


11.40 


(1.08) 


11.70 


(1.16) 


11.36 


(1.21) 


11.33 


(1.07) 


(0.23) 


Crar'.e 


5.70 


(60.48) 


5.50 


(0.53) 


5.55 


(0.69) 


5.50 


(0.52) 


(0.29) 


Percent Black 


70.00 




40.00 




9.00 




42.00 




12.78* 


Percent male 


60.00 




90.00 




99.00 




67.00 




4.48 


Percent retained 


30.00 




20.00 




36.00 




33.00 




0.75 



*£< .05. 
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Table 3 



Frequency and Accuracy of Monitoring Sessions 



Variable 


BC 1 


BC 2 


BC 3 


M 


(SD) 


M 


(SD) 


M Kn) 


Number of sessions 


A on 


/ 1 AO \ 


10.90 


(2.02) 


11.73 (2.76) 


Heek 1 




/ n 07 \ 


4.80 


(0.63) 


4.82 (0.40) 


Heek 2 




in f^l\ 

IU« Q/ / 


3.00 


(1.15) 


3.55 (1.13) 


Heek 3 


2.50 


(0.97) 


3.10 


(1.10) 


3.36* (1.63) 


Percent of sessions completed 


91.33 


(13.39) 


93.20 


(7.94) 


93.27 (10.35) 


Percent of sessions completed 












with perfection 


70.00 


(28.55) 


90.50 (10.24) 


79.27 (22.31) 


Percent of session components 












completed with accuracy 


87.67 


(14.99) 


96.50 


(3.89) 


90.82 (9.99) 



* £ < .001. 



o 

ERIC 



44 



Table 4 

Percentage of Observed Intervals during which DTT Pupils and Peers Demonstrated 
(DTT Pupils') Target Behavior and Discrepancies at Pre, Post, and Follow-up 



BC 1 BC 2 BC 3 Controls 

DTT Peers DTT Peers DTT Peers DTT Peers 

Trial M (SD) M (SD) DIs* M (SD) M (SD) DU M (SD) M (SD) DU M (SD) M (SD) DU 

Pre 46 (23) 25 (21) 21 53 (23) 24 (18) 29 42 (18) 17 (14) 25 41 (23) 12 (14) 29 

Post 20 (11) 13 (8) 7 19 (12) 20 (15) -1 14 (8) 17 (16) -3 38 (22) 11 (9) 27 

Follow 24 (17) 19 (13) 5 19 (19) 17 (10) 2 18 (15) 18 (17) 0 47 (23) 5 (7) 42 

^DIs Is the discrepancy between DTT students and peers. 
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Table 5 

Teacher Ratings of DTT Pupils' Target Behavior across ScaUs of 
Severity, Manageability, and Tolerableness' 



BC 1 BC 2 BC 3 Controls 

Trial M (SD) M (SD) M (SD) M (SD) 

Pre 5.50 (2.51) 5.80 (2.10) 6.55 (1.21) 5.75 (2.18) 

Post 10.20 (3.12) 10.10 (4.07) 11.27 (2.65) 6.00 (1.65) 

Anonymous 10.10 (3.97) 11.90 (2.38) 11.27 (3.58) 7.58 (2.54) 



^The teacher ratings ranged from 3 (least desirable) to 15 (most desirable). 



Teacher Responses on the Revised Behavior Problem Checklist^ 



Table 6 



Scalesb M (SD) M (SD) M (SD) M (SD) M (SD) M (SD) M (SD) n (SO) 

CO 19.80 (10.73) 16.60 (12.50) 19.80 (8.59) 12.10 (10.98) 9.73 (10.69) 5.00 (6.83) 20.83 (11.16) 23.08 (11.97) 

SA 2.90 (1.97) 3.80 (4.49) 7.00 (3.56) 4.90 (4.33) 2.64 (5.95) 1.27 (2.24) 5.00 (3.46) 6.50 (5.58) 

AP 21.00 (6.20) 13.80 (7.30) 20.60 (5.66) 14.80 (5.16) 17.55 (6.98) 11.73 (5.35) 16.00 (6.80) 15.17 (6.25) 

AM 6.90 (5.69) 5.20 (2.74) 5.30 (2.75) 3.60 (2.72) 7.18 (4.35) 4.55 (3.80) 5.83 (4.67) 6.08 (4.46) 

PB 3.00 (1.94) 1.90 (1.91) 2.80 (2.66) 1.40 (1.65) .91 (1.58) .64 (1.03) 2.00 (2.45) 1.67 (1.67) 

ME 4.90 (3.70) 4.60 (3.60) 5.30 (2.21) 3.50 (2.46) 4.55 (3.30) 3.91 (2.59) 4.17 (3.04) 3.42 (2.39) 

Total 58.50 (20.13) 45.90 (29.00) 60.80 (16.68) 40.30 (20.90) 42.55 (22.46) 27.09 (14.18) 53.83 (19.52) 55.97 (17.67) 



*Lower scores are more positive than higher ones. 



Ho « Conduct Disorders (22 Items, maximum score = 44), SA « Socialized Aggression (17 Items, maximum score « 34), 
AP » Attention Problems (16 Items, maximum score = 32), AM = Anxiety Mithdrawal (11 Items, maximum score « 22), 
PB = Psychotic Behavior (6 Items, maximum score = 12), ME » Motor Excess (5 Items, maximum score « 10). 
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Tgacher. Consultant, and Student Itesponses to Questionnaire 



BC 1 BC 2 BC 3 

Ite« M (SD) M (SD) M (SD) 

Teacher 

Has the project effective? 3.40 (1.26) 3.00 (1.05) 3.82 (1.25) 

(1 ■ complete failure, 5 > complete success) 
ias the project worth doing? 3.90 (1.37) 3.90 (1.37) 4.36 (1.21) 

(1 - not at all, 5 - definitely) 
Old It contribute to your professional development? 3.40 (1.07) 2.90 (1.20) 3.27 (1.42) 

(1 ■ not at all, 5 ■ very much) 
Hill you continue to use the Intervention? 3.20 (1.62) 3.60 (1.07) 3.55 (1.29) 

(1 - not likely, 5 - very likely) 
Mill you volunteer for the project next year? 3.60 (1.51) 3.00 (1.56) 3.55 (1.44) 

(1 - not likely, 5 - very likely) 
Has the project feasible? 3.40 (1.07) 3.30 (0.82) 3.64 (1.29) 

(1 - not at all, 5 - very much) 
How collaborative was your consultant? 4.70(0.95) 4.00(1.63) 5.00(0.00) 

(1 - not at all, 5 « very) 
How helpful was your consultant? 4.60 (0.70) 4.20 (0.92) 5.00 (0.00) 

(1 - not at all, 5 « very) 

Consultant 

Has the project effective? 3.20 (1.32) 3.30 (1.16) 3.82 (1.25) 

(1 > complete failure, 5 > complete success) 
Kow effective were the student- teacher contracts? 4.10 (0.88) 4.20 (0.63) 4.18 (0.87) 

(1 « not at all, 5 - highly) 
How Important was monitoring? 4.60 (0.70) 4.50 (0.53) 4.55 (0.69) 

(1 - not at all, 5 - very) 
Has the project worth doing? 4.20 (1.23) 4.10 (0.88) 4.18 (1.17) 

(1 « not at all, 5 « definitely) 
Did It contribute ot your professional development? 3.60 (1.51) 3.80 (1.23) 3.45 (1.37) 

(1 ■ not at all, 5 « very much) 
How directive were the written scripts? 2.90 (0.57) 2.90 (0.32) 3.00 (0.63) 

(1 « too much, 5 ■ sufficient) 
How supportive was the technical asslstanct? 5.00 (0.00) 5.00 (0.00) 5.00 (0.00) 

(1 « not at all, 5 « ^ery) 

Student 

How much has your behavior Improved? 4.30 (0.67) 3.80 (1.23) 3.91 (0.70) 

(1 « not at all, 5 « very much) 
Would you recommend that more teachers use contracts? 4.50 (0.53) 3.80 (1.23) 3.82 (0.87) 

(1 « no, 5 « strongly) 

How Important was your reward to you? 4.20 (0.42) 3.90 (0.74) 4.00 (0.77) 

(1 « not at all, 5 « very) 
How hard did you work on your contract? 4.20 (1.03) 3.70 (0.95) 3.45 (1.21) 

(1 « not at all, 5 « very) 
How serious was your teacher about the contract? 4.60 (0.70) 4.80 (0.42) 4.36 (1.21) 

(1 « not at all, 5 « very) 
How fair was the contract? 4.10 (0.74) 4.80 (0.42) 4.82 (0.40) 

(1 « not at all, 5 « very) 
How much fun was It? 3.90 (1.29) 3.90 (1.20) 4.45 (0.69) 

(1 ■ not at all, 5 ■ very much) 
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Figure Captions 

Fig lire 1, Sequence of consultant activity In least (BC 1) to most (BC 3) 
Inclusive versions of SC. 

Figure 2> Discrepancies between DTT students' and peers' percentage of target 
behavior. 

Figure 3. Teacher ratings of DTT pupils' target behavior across Severity, 
Manageability, and Tolerableness scales. 

Figure 4. Teacher-assigned scores on the Revised Behavior Problem Checklist: 
Conduct Disorders (A) and Attention Problems- 1 irmaturity (B) scales. 
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WEEK CONSULTATION ACTIVITY EXPERIMENTAL GROUP 

BC 1 BC 2 BC 3 



1 



Meeting 1 
Observation 1 

Observation 2 
Meeting 2 
Intervention begins 

Classroom visit 1 

Classroom visit 2 

Observation 3 
Observation 4 
Intervention ends 

Meeting 3 



Modified intervention begins 
Classroom visit 3 



8 



Observation 5 

Modified intervention ends 

Meeting 4 



^Consultants and teachers had the option to pursue the activity, 
depending on the evaluation of MAT effectiveness at that point. 
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